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ABSTRACT 


A study and documentation of the first annual Award for 
Excellence in Teaching is made. A brief background for the 
Award is presented, including the formation of a committee 
designated to choose objectively a worthy recipient. The 
problems encountered by the committee in designing a success- 
ful ballot and the statistical methods used in se Feceinanenc 
recipient are of major concern and are Ereated in detail, 
Basic response statistics are published accompanied by a 
data summary. Special Studies including score analysis, 
weight component determination, and teacher elimination by 
dominance techniques are presented. To better understand 
the various population strata, several correlation studies 


are made. 
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I. BACKGROUND 


In May, 1969, the Superintendent of the Naval Postgrad- 
uate School, Radm. Robert W. McNitt, USN, established the 
Outstanding Teaching Award to be conferred upon a member of 
the Faculty of the Naval Postgraduate School annually at the 
time of the June Graduation Exercises. It was meencee that 
the first conferral of the Award be made in June, 1970, 

Selection of the recipient was to be accomplished accord- 
ing to certain guideline procedures prepared by an Ad Hoc 
Committee appointed by the Academic Dean. The Ad Hoc Commit- 
tee consisted of Professors Gaskell (Chairman), Handler, 
eetoole, and Strum. In addition to basic guidelines, the Ad 
Hoc Committee made provisions for the establishment of a 
permanent selection committee to choose the recipient annually, 
thus insuring a growing efficiency and refinement of the pro- 
cess. Membership on the committee would be for two year pe- 
reiods, with exception of the first committee, and each year 
half of the committee would step down, thus combining past 
knowledge and familiarity of the problem with new talents 
and ideas. 

The first selection committee finally evolved to the 
membership of Professors Gawain (Chairman), Kovach (Vice- 
Chairman and Secretary), peeeesd: Nunn, Read, Strum, and 
Woehler. The initial efforts of the selection committee 
were towards setting a general tone for the award itself. 


It was felt that a small group of the Faculty members could 
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be identified who merit consideration for the Award, but 
that a selection from among this group of one individual, 
however deserving he may be, was not likely to preempt all 
other candidates in every respect. Therefore, it was felt 
that the selection of one individual could properly be re- 
garded as a representative and symbol of the excellence of 
ns peers. 

In attempting to fulfill its assigned responsibilities, 
the committee tried to formulate an adequate philosophical 
outlook concerning the nature of excellence in teaching and 
how it could be reliably identified and evaluated. After 
much research, both outside and inside the committee, the 
Committee reached the following general conclusions: 

(a) There did not exist any objective and gener- 
ally accepted method for quantitatively measuring 
excellence in teaching. 

(b) Experience at the Naval Postgraduate School 
and elsewhere indicated that mature students and 
other qualified observers do on the whole show a 
reasonable degree of consistency in judgments of 
persons engaged in teaching. 

(c) The Committee could properly designate the 
recipient on the basis of the representative judg- 


ments of persons qualified to hold opinions. 


(d) It appeared that a polling procedure could 
be used to achieve this objective. 


(e) Well developed statistical techniques were 


available which could be used to guide the quanti- 
tative interpretation of the poll. 


The Committee next desired to put down on paper some 
statement that approached the correct interpretation of the 


phrase "excellence in teaching." This phrase was to refer 
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to that complex of personal and professional qualities and 
actions on the part of the teacher which: 


(a) Make themselves felt primarily at the inter- 
face of personal contact between student and teacher. 


(b) Help transmute the student's encounters with 
his subject matter into insight, enlightenment and 
love of learning. 


(c) Elicit from the student responses in thought, 
feeling, and action which enhance his capacity for 
- self education. 


(d) Manifest themselves in an effective individual 
style which authentically reflects the teacher's 
own unique personality, experience, character, and 
COnvictions. 


With reference to the actual polling procedure to be 
followed, the Committee proposed the following specific points: 


(a) The following individuals would be eligible to 
participate: all students, all Faculty members,’ 

all Curricular and Assistant Curricular Officers, 

and a representative group of recent alumni. The 
exact composition of this group to be specified later. 


(b) Participation in the poll would be entirely 
voluntary. 


(c) The polling would be by secret ballot. 


(d) Stringent security measures would be taken to 
guarantee that the poll could not be misused in any 
fashion which would be detrimental to the status or 
interests of any individual Faculty member. 


(e) In order to be eligible to participate in the 
poll, an individual must have indicated that he con- 
siders himself to be reasonably well acquainted with 
the actual teaching performance of five or more 
Faculty members. : 


oe 


‘Department Chairmen and members of the Selection Committee 
were declared ineligible to receive the award. They were not 
excluded from the poll, however. 
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(f) Participants would be cautioned to avoid 
nominating teachers on the basis of mere personal- 
ity or popularity. No attempt would be made to 
provide a definite check list of required qualities 
for excellence in teaching. The Committee's guide- 
lines in this area were to be optional. 


(g) Data obtained in the poll would be analyzed 


objectively, using appropriate statistical methods 
which would take into account all relevant factors. 
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Pe CONDUCT OF POLL 


A. BALLOT FORMAT 

After setting the philosophical tone of the award, the 
selection committee directed its attention to the appropriate 
alleys format. It was decided that the ballot itself would 
consist of three basic parts. The first, a statistical infor- 
mation séction, was designed to obtain data to help understand 
various characteristics of the polled population. The second 
part consisted of a listing of the faculty eligible for the 
teaching award, and the third-part was to invite a supporting 
remark for the voter's primary nomination. A sample ballot 
is included in Appendix A. 

Information requested in Part I of the ballot provided 
data for statistical procedures to be used in an effort to 
gain a better understanding of the voter population. It was 
desired to know the Voter Category of each individual being 
polled. Consequently, the four categories consisting of 
Student, Faculty, Alumnus, and Curricular Officer were used. 
These four categories were desired to be mutually exclusive 
and totally exhaustive. 

If the voter were military, additional information as to 
Rank and Branch of Service was requested. If the voter were 
peo eudenc, Nis curricular area would be of interest, and if 
he were a member of the Faculty, his Academic Rank and Depart- 


ment would supply pertinent statistical information. 
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The second part of the ballot displayed a listing of the 
eligible faculty, or those faculty who had engaged in teach- 
ing during the current academic year, except department chair- 
men and members of the selection committee. 

An effective method of listing the eligible faculty was 
desired. The committee, realizing that most students (and 
consequently, alumnus) and faculty identified a teacher with 
an academic department, decided to have thirteen major heads 
corresponding to the thirteen departments. Within each de- 
partment, the teachers were listed alphabetically. Hopefully, 
this method would facilitate finding a specified group of 
teachers with which the voter would be acquainted. 

Poe tea lewaicmineluded to Obtain Subjective information 
supporting the primary nomination of the voter concerned. 
Eance this information was optional, the committee decided 
not to fix any policies regarding its usage in the selection 
process. But, such information would provide an inlet for 
subjectivity in the process which the committee felt might 
be necessary and appropriate. 

To accompany the actual ballot, a page of publicity and 
instruction was felt necessary. The committee decided that 
such a page should consist basically of two parts: a short 
statem-nt of the background of the award and a statement of 
the balloting procedure. Therefore, a short summary of the 
philosophical thinking of the committee was included to 


iMeroducesthe suoject Of “teaching excellence” to the voter. 


e 
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The balloting procedure consisted of five steps; three 
of which require explanation. Step 1 requested the voter to 
emceircle the teacher number of all the faculty with which he 
was "sufficiently acquainted to make a judgment." It was 
emphasized that the voter encircle all those that fell into 
the above category in order to establish a basis of comparison. 

In Step 2, the voter was directed to select one (1) to 
three (3) nominees and to rank them in order of preference. 
The committee decided that a scoring system would be based 
on points awarded for first, second, and third place votes 
only. j 

Finally, Step 3 invited the voter to utilize Part III of 


the actual ballot by giving supporting remarks for his first 


place nomination. This step was to be optional. 


B. VERIFICATION OF DATA 

The listing of teachers described above included a four 
digit number identifying each teacher. These numbers served 
a two-fold purpose. They were used in the processes of data 
collection and statistical manipulation; and secondly, the 
numbers served as a verification process by which the IBM 
Gata cards could be checked for key punch errors. 

Each teacher number was constructed in the following 
manner. The first three digits formed a number that increased 
in numerical order for each teacher going down the listing, 
starting with number 101. Therefore, the second teacher down 


Picwlistetadethe first three digits 102, the third teacher, 


e 
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203, etc. Let WN be a vector whose elements consist of 
these first three digits. The fourth digit of the teacher 
number was obtained by using the units digit of the inner 
product N - S' , where S was an arbitrary weight vector 
chosen to (351). As an example, for teacher 101, the 


meget Gigit would be the units digit of 


3 
GiiOrL) 1-5 Om 4%, 

i 
Thus, his full number would be 1014. This procedure rendered 
itself to computer verification of all key punched data cards. 
Other verification techniques appropriate to the programming 

L 

language (COBOL) were used for the statistical information 


Ppsovidged in Part I of the ballot. 


C. RESPONSE ANOMALIES 

Although much effort was put into the design of the ballot 
format, it was anticipated that not every point would be clear 
to the individual voter. An analysis of the returned ballots 
proved this conjecture to be true. 

Multiple answers in any one of the informational areas of 
Part I would cause problems for proper statistical analysis. 
It was found that although the Voter Category information was 
totally exhaustive, it was fot mutually exclusive, especially 
among the Alumnus and Curricular Officer categories. Conse- 


quently, revision of the collection process for this informa- 


tion is required. Confusion became apparent as to which 


- 
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Military Rank category a foreign officer belonged... Proper 
corresponding ranks should be outlined in any future polling 
©£ this sort. It was discovered that the options under 
Curricular Area were not mutually exclusive. An attempt was 
made to correct the above errors by examining the ballot con- 
cerned. Such errors were not used as a basis for ballot re- 
jection. 

The an common cause for rejection of a ballot was the 
requirement that the voter be acquainted with at least five 
faculty members listed as eligible teachers. This require- 
ment was established since the committee felt that each voter 
should be acquainted with at least a certain minimum number 
of teachers in order to make a meaningful comparison. The 
number five seemed reasonable. It would ene most first 
quarter students but very few of the others. This rejection 
Principal, although resulting in a “void” ballot, could not 
be considered an error on the part of the voter and conse- 
quently, was not a function of ballot format. The requirement 
was not publicized on the ballot, however. 

Two other major causes of rejection were late ballots and 
multiple selections for first, second, and third place votes. 
After a certain date, late ballots could no longer be consid- 
ered in the selection process and therefore became void. 
Also, there were many ballots returned eric because of the 
lack of forwarding addresses. A substantial number of voters 
interpreted the procedure instructions to mean that multiple 


Chotcess for ritste, second, or third place nominations were 
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acceptable; thus, future clarification of this mis~interpre- 
tation is needed. Table I summarizes the void ballots. Late 
ballots consisted of alumni ballots received in the mail too 


Hate fOr processing. 


TABLE I 
Void Ballot Summary 


A. Late ballots 


Valid 20 
Vord Z 
Blank (Returned oy 

to sender) 
Igy EEtojor 9S) - . legal 
C. Multiple Nominations 24 


There were 1023 valid ballots used in the selection process. 
The results of the poll would become more representative and 
the statistical findings more meaningful with a reduction in 


the number of void ballots. 
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ieee OrULALTON CHARACTERISTICS 


Poe RESPONSE STATISTICS 

One of the most interesting and important population 
characteristics concerned the degree of voluntary participa- 
tion the Teaching Award could eocen In order to ascertain 
the level of interest reached by the voter population, basic 
response statistics were compiled. These statistics were 
based only on valid ballots; ballots that were free from the 
errors listed above and had M, > 5 , where M, was the size 
of the population On teachers identified by the ith voter. 

Response by Voter Category gave general response statis- 
tics. Table II gives a two-way classification of the Student 
ballots received. Each interior entry in the table represents 
the number of ballots received from the ith Military Rank 
of the jth curricular Area. The top row is a count of those 
Student ballots listing only a Curricular Area. Similarly, 
the left-hand columm represents those ballots known only by 
Military Rank. The bottom row gives the percentage response 
within each Curricular Area. In review, from the 1485 stu- 
dents at the Postgraduate School when the poll was conducted, 
728 responded in an acceptable manner, yielding an overall 
response of 49%. 

Table III shows a similar response for the Alumnus ballots. 
Each interior entry represents the number of ballots received 


from the ith piiitary Ranking of the jth curricular Area. 
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Abies wl 0 


Response by Student Voter Category 


SLugene Curricular Area 





P Students known in Curricular Area only 


Q Students known in Military Rank only 
R Student Ballot Distribution by Rank 


Total Response by Curricular Area 
Total Enrollment of Each Area 


= 
T 


U Percentage Response by Curricular Area 
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TABLE III 


Response by Alumnus Voter Category 


Student Curricular Area 
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The top row and left-hand column have the same meaning as 
above. The bottom row is the total response from the jth 
Curricular Area. Since there were two ballots that did not 
Biabeate a Military Rank or Curricular Area, the total Alumnus 
response was 208 ballots. There were 530 ballots mailed, 
waelding a return of 39%. 

It should be noted that the polling of Alumni poses some 
difficult problems. They must be contacted by mail, and hence 
a listing of current addresses is needed. This need can be 
served, to a large part, by the use of Reference 2 and the 
associated data tape which contains a’ list of previous gradu- 
ates. There are shortcomings, however: 

(a) The tape contains listings of former officer 
students restricted to Naval personnel who are still 
active. Moreover, the tape requires periodic up- 
dating to keep the addresses reasonably current. 

(b) The addresses contained on the tape are coded. 
These must be translated into addresses that are 
usable in the mail system. Such can be accomplished 


with the aid of References 7 and 8, but experienced 
personnel are required to do this. 


Experience suggests that at least two months lead time are 
needed to update the tape, and at least one month to translate 
the addresses. 

Table IV shows the response of the Faculty ballots. Each 


interior entry represents the ratio 


@ 


# of ballots in the i,jth category 
total # possible 
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TABLE IV 


Response by Faculty Voter Category 
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E Faculty known in Academic Department only 
F Faculty known in Academic Rank only 

G Total response by Academic Department 

H Percentage response of Academic Department 


thus, it is the fractional response by Academic Rank from 
each Department. The top row and left-hand column again have 
the same interpretation as above. The bottom row gives the 
percentage response within each Academic Department. There 
were four (4) ballots received that did not list an Academic 
Rank or Department; PiMcPruneetota lL response from the Faculty 


was 74 ballots out of 289. The overall response of the 


@ 
_ 


Faculty was 25.6%. 


Of the ten Curricular Offices, a total of three ballots 


was received. - 
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Peete ehO2sevalid ballots used by the selection committee, 


the Voter Categories represented the following percentages: 


Curricular Office oe 
Alumnus 20.38 
Faculty 1.28 
Student Wiig 
Unknown E.Ls 


B. DISTRIBUTION ANALYSIS OF N AND M; 


k 

wea Lurther attempt to better understand the voter 
population, two characteristics were of interest. Associated 
with each ballot was the mEbes of teachers identified by 
that ballot, and associated with each teacher was the number 
of voters identifying him. To Gain this understanding, 
analyses on these two characteristics were made. 

Figure l is a histogram of Ny , the number of voters 
identifying the ,th teacher. The average value of Ny 
was 64.5, with a standard deviation of 49.4, 

Figure 2 shows a frequency distribution of M. for 
the Faculty voters only; where M. is the number of teachers 
identified by the jth voter. Similarly, Figure 3 is a 
distribution of M. for all the voters. 

Ze is interesting to note the high average of the Rae uivtey, 
Bballoers, S221 when compared to that of 15.5 for all the 
ballots. Undoubtedly the faculty's criteria for "being ac- 
quainted" with a teacher are different from those of the 


students. 
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FIGURE 3 


Frequency Distribution of M. for All Ballots 
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C. DISTRIBUTION ANALYSIS OF Di. 


Since an option was left to the voter whether or not to 
add a supporting statement, it was desired to know how the 
voter population reacted. The following analysis was made 
with this objective in mind. 


Define Xi to be the number of ballots awarding a first 


place nomination to T, , and D, to be the number of these 


that add a supporting statement. Figure 4 is a scatter dia- 


Beem Or: P, vs. Xik Fi Xik Eee nere — P — ) the 


k 1k 


that voluntarily added a comment. 


k 


proportion of Xi, 
To estimate the probability that a supporting statement 


was made, a "pooled" value of P resulted in 


k 


p= ) D,/ Max = .341 


Examining Figure 4, it would be difficult te conclude 
enbat P, was in any sense approximately constant, or that 
any correlation coefficient other than zero would fit the 
observed data. It was concluded that the probability of 
receiving a supporting statement was independent of the 


number of first place votes. 
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Xik (# of first place votes) 


FIGURE 4 


scatter Diagram of P, VS- Xix 
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IV. DATA SUMMARY 


The following is a summary of the Seree utilized by the 
committee in the selection process. Each row represents the 
pertinent data for a single teacher, and is ranked from top 
to bottom in order of decreasing score, where teacher k's 


score is defined to be 


and W is the weighting vector analyzed below. N, and Dy 
are as defined above, and Xx , i =1,2,3 are the number 
of first, second, and third place nominations received by 


teacher k ., 
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250207 
ZS IDIS 
2235019 
2.21154 
2.01099 
1.78082 
1.74074 
13353 
1.71429 
P6062 39 
1.61842 
Il S52 
1.41538 
1.35616 
29927 
1.28205 
1.28000 
27778 
1.24590 
1,18868 
Te 182 
1.13115 
1.02913 
1,00000 
0.97826 
0.97826 
0.96629 
0.96262 
0.94444 
0.90625 
0.88889 
0.87850 
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0.85000 
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0.80000 
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0.66102 
0.65000 
0.64474 
0159677 
0.59494 
0.58065 
0757143 
0.56364 
0.54545 
0.53846 
0.52830 
0.92632 


0.52500 


0.52174 
0.51064 
0.51020 
0.50000 
0.48387 
0.46281 
0.44872 
0.44304 
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0.33846 
0535353" 
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Voor nCtAL ANALYSES 


The following special studies were conducted in order to 
objectively choose a worthy recipient and also to gain know- 


tedge concerning the distribution of positive scores. 


A. DOMINANCE CONCEPT AND SCREENING RATIONALE 
1. Background 

In this section, a concept of dominance is developed 
and discussed which served as a powerful screening criterion 
leading to the final selection of the award winner. 

Let Th. represent teacher k- and Ny represent 
the number of voters indentifying teacher k on their ballots. 
Define Xx aS above. Now, let Vix = X51 /Ny pete = Lee, 3S 
represent the fraction of first, second, and third place votes 


awarded to T fronetene population that knew him. Therefore, 


k 


each teacher has a return vector, V which 


x 1K V2 V 34) 
will be used to measure his excellence as a teacher. Table V 


meea Gisplay of V for the top 25 teachers. 


k 
2. Development 


Teacher k's score, Si , can now be represented by 


(i) 
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Return Vector V 


TABLE V 


k 
k Vik Vok Y3k 
iL 0.48276 Cal7241 0.08621 
2 0.50847 0, 13559 0705085 
5} 0.50943 0.12264 0.04717 
4 0.46154 0.11538 0.13462 
5) 0.43956 0.08791 0.07692 
GO: 0225926 0.29630 0.11111 
7 0.30137 0.23288 0710959 
8 0.28090 OF 23595 0.08989 
) 0.34167 0.12500 0.11667 
10 O730555 0.16667 0.04762 
11 0.25000 0.25000 0.11842 
12 0.29630 0.13580 0.06173 
13 0.26154 0.13846. 0709231 
14 0.24658 0513699 07095869 
15 0.19708 0.20438 DeLoz to 
16 Oee2e22 0.16667 0.05556 
17 O22 3077 0.15385 0.05128 
18 0.26000 0.08000 0.08000 
19 0.16981 0.15094 On 7 0755 
20 OnZ295" 0.11475 0.09836 
21 0.18182 0.20455 0.04545 
22 0.19672 0.13115 0.08197 
23 0.14563 0.18447 0.07767 
24 Oe 725 O517647 0.09804 
25 0.19565 0.07609 0.04348 
where W = (w),W5,W,) is a weighting vector to be specified 


later. 


In general, W is subject to the constraint that 
Wenpenweew W. .> 0 . (2) 


It would be non-sensical to “give more weight to either a 
second or third place vote than to a first place vote. Con- 


sequently, from (2) above, 
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0 < W/W, <> i. 


3) 
and Ome W3/W> <<a 


A further restriction is necessary since values of Wo/Wy 
and W3/W> too near zero or unity are also undesirable. 
This would mean that either a second or third place vote re- 
ceived a weight of zero, or that they are weighted equally 
with a first or second place vote, respectively. Therefore, 


the inequalities in (3) above can be rewritten 


0 < ay S Wo/Wy < by <i 
2 (4) 
and Onr< a, < W3/Wo < bo ae ae 
Thus, (a) ,b,) and (a, ,b.) define a preferential region 


interior to the unit square. Figure 5 shows -such a preferen- 


tial region when a, =a, = E73 and by = bo = 2/3 





FIGURE 5 


- Preferential Region For 


a, = a, = 1/3 and by = bo = 2/3 
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The shaded region represents points satisfying the general 
constraints in (3) above. The smaller square area DEFG 
depicts the preferred region where the ratios Wo/Wy and 
w/w Satisfy the constraints in (4). The region outside 
the larger square OABC violates the inequalities in (2) 
and (3) above. 

Concepts of dominance will now be developed. Let k 
and k' sendes any two teachers. It is desired to find all 


possible values of W_ so that 


Sy > Sy 
Therefore, 
Se eee ook oak = i Yint * Wo%axs * %3¥ 3x1 
or 
Me se * Yay ~ Vays) + W31V3, — Vap2) 20+ ©) 


The first form of dominance becomes obvious from (5) 


above. When V erUe ed = 1,2,5 4° then o.. > $s 


ik ~ Yak k k! 


and §S can be eliminated from competition. This form of 


a 
dominance is termed absolute dominance. (See Table v). 
Another form of dominance is readily generated 


following the observation that (5) defines a straight line in 


the two dimensional space of’ Figure 5. From (5), 


~ Ws = 
po eee ee Yo! © yy Vax ~ Vaxr) 2 0 
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eee US wy 2k 2k" es 
Wie V2zz V3y1 W2 V3, oe V3_8 : 
where Ware ; Vay ~ebo=ele 2,5 are Known. The set (6) can 
be simplified to 
W 3 Wi 
wo > Akk' wa * Pkk! oti. 


where — and Bugs are known constants. Consequently, 


the set (7) defines a half-space in which Sy dominates Sit 


S. S a --Case IV 
W3 Gace [iT 
W2 Sy > Se, 
i} ei a =e Case II 


Ww] Nd 
\ 

ep) 

nN 

Vv 

n 

nm 


FIGURE 6 


Case Examples’ of Dominance. 


Bigure 6 is a plot of W3/Wo vs. w,/W> - Converting 


the old limits of w/w to new limits for wi/W. yields 





7 2 w/w. oe (8) 


Hhaese limits are plotted in Figure 6, together with four 
cases of dominance. 

In Case I, all the points that are feasible, those 
that satisfy (2) and (3) above, lie in the half-space where 
Si. > Sys . This is termed complete dominance. Absolute 
dominance is observed to be a special case of complete domi- 
Wace. Case ITI may be called incomplete dominance; that is, 
where Si. 2 Sh Over portions of the feasible region, but 
not any of the preference region. In-Case IV, the points 
necessary for Sh > She are infeasible, resulting in S,.'s 
elimination from competition. Case II represents the most 
Semeeresting Situation. In this case, both Sy and She have 
the feasible and preferential ability to eliminate the other 
depending on the selected weight system. 

3. Results 

In the actual data, only thirteen teachers out of 249 
remained after an initial screening for absolute dominance. 

A secondary screeing for complete dominance reduced the group 


to four. A final screening for incomplete dominance further 


reduced the eligible teachers to a group of three. 


Figure 7 shows the results of this analysis. Let 


onl 


>! and Ms be the teachers surviving the dominance 


screening criteria. From the data, Sy > So when 


- 


Ww Ww 
ee oo 
W2 W2 
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FIGURE 7 


Results of Dominance Techniques 





This region is represented by the trapezoidal figure ABCD. 
pamilarly, S5 > S3 when 

EES 1 SETI chat 

W2 W2 
and Sy > S. when 

pS Ea .68 bale aa Ihe 2033 e 

W2 oW2 
These dominance lines generated areas where Ti To 1 and 
T, could win-the poll based on score alone, given that the 
point an fell into their respective regions. Several 

2 e 
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further analyses of the data were made in an effort to choose 


among the three undominated teachers. 


B. PRINCIPAL COMPONENT ANALYSIS -- DETERMINATION OF WEIGHTS 
ive background 

For purposes of preliminary analysis of the data, it 
was convenient to use tentative weights for first, second, 
and third place votes, and to rank the teachers according to 
the resulting scores. Several sets of weights were suggested 
by the Selection Committee (such as 3:2:l1 and 4:2:1) and 
ultimately the system 4:2:1 was chosen for use in the dis- 
tribution and correlation studies. This selection was in- 
fluenced by the following analysis. 

It is reasonable to choose weights that would maximize 
the variance of the scores. This would facilitate ranking the 
teachers in a preferred order and reduce the number of scores 
very close together. In two dimensions, a teacher's score 
could be represented by S = WX, + WoX> which when graphed, 
becomes a straight line in the (x) 1X5) space. Figure 8 is 
such a plot. 

In three dimensions, these lines become planes and 
the objective in either case is to spread these lines or 
planes as far apart as possible. The method of principal 
components was used to obtain the set of weights that would 


accomplish this objective. 
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FIGURE 8 


Two-Dimensional Plot of (X) 1X5). 


2. Development 


Teacher k's score, Si , can be represented by 


3 
Sees We Vi 
i=1 
where W is the desired weighting system. The objective is 
to choose W_ so as to Max [var (S,)] . Since the scores 
could be made arbitrarily large by letting W be unbounded, 


a constraint on W is needed to solve the mathematical prob- 


tenes Le 1S Convenient to use the form 


W'w=1 : (9) 


to constrain the weight vector. 
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Define |v = (V, 1V5/V3) , where V5 is the average 
maue Of the fraction Of first, second, and third place votes 


taken over all teachers, 


ne 
oe ve, 1 = 1,2,3 
ak Mo RET ik 

and where My is the total number of teachers identified by 


the ballots. The variance of the scores can be written 


var (S,) = Ge (150) 


where C is the square, symmetric variance-covariance matrix 


- 


of the Vv; Swe ds G6 
Ci5 = ae = (Vy - 7) el 2 3 
ay Kk. 
Combining the objective function and the constraint 


on W into the classical Lagrangian for the maximization 


problem yields 
L(W,A) = W' CW - x(W' W- 1) , (11) 


where i is the Lagrange multiplier. Equation (11) can be 
rewritten to facilitate obtaining the partial derivatives, 
TRGMi ; eG d( ; wee Ty (12) 
j=. el — 


we 


Taking the partial derivatives with respect to W 
and A and setting them equal to zero to obtain the maximizing 


value of W yields: 
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opin) =2CW-2,AW= 0 (13a) 
= 
and ep At A = Wiew =e t= 0 . (13b) 


Rearranging (13a), (C - AI) + W=0 , results in a system of 
3X3 linear, homogeneous equations. Their solution is either 


trivial, W= 0 , or the coefficient matrix is singular, 


(Ce ext| =200. (14) 


a 


It should be noted that (14) is the characteristic equation, 
a third degree polynomial in i , where the i's now also 
represent eigenvalues associated with the covariance matrix. 


From (13a) above, 


T 
=I 
Q 
= 


and Var (S,) 


ll 
=| 
~ 
=| 
i 


AW'W, 

and using (13b), Var (S,) = A’ . Thus, it follows that 

var (S,) is maximized when )A is maximized, and that the 
set of weights maximizing A is the eigenvector associated 
with A. Therefore, utilizing as the weighting system the 
eigenvector associated with the largest eigenvalue of the 
characteristic equation, results in a system that separates 


the scores as much as possible. 
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A fundamental fault with this approach concerns the 
satisfaction of the general and preferential restrictions 
on W. There is no guarantee that ee 5 will occur 
or that the inner restrictions (a, ,b,) and (a,,b,) waa 
be satisfactory. 

3. Results 
"from the data collected, 
OOS 5 WO SS .0017 


C = UO ess) 20035 5 UES A 
OOLT -U0LS nOO2 


The largest eigenvalue is i = .011 , and the associated 
eigenvector is W = (.86,.45,.24) . This vector was modified 
to the simpler form W = (4,2,1) . Since both general and 
preferential limits were satisfied, (4,2,1) was used to 


weight first, second, and third place votes with the added 
knowledge that the resulting scores would be relatively well 


spread apart. 


C. PAIRED COMPARISONS ANALYSIS 

A special study was conducted on the top twenty teachers, 
where the top twenty was defined to be the twenty highest 
scoring teachers. This study consisted of comparing each 
pair of the twenty. For each pair, the score was based only 
on that sub-population of voters that identified both teachers. 


Define TyrTos See | to be the top twenty teachers 


20 


ranked in decreasing order of score. In this paired compari- 


son analysis, Ty would be expected to win over all others, 
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and T 59 would be expected to lose. If T) lost in any Of 


these tests, significant argument might be made for giving 


the award to another high ranking teacher, say T, or TT, . 


8) 


Again, let k and k' denote any two teachers and now 
let Nuys be the size of the population of voters knowing 


both teachers. Clearly, { } = {Ny iee4 eee Table Vi 


Nk 


is a display of the square, symmetric matrix N 


Define a new score, Sigs , to be the score of teacher k 


based on the sub-population, { } . Similarly, let S&S 


Nix 


be the score of teacher k' based on { 


k'k 


Niet . Table VII 


Go the square matrix of S&S In general, S,4, 7 Sit 


kee 
and the matrix in Table VII is not symmetric. 
Table VIII shows the results of such a paired comparison 


analysis for the top five teachers ranked as described above. 


Looking at the analysis for T) ' Nye is defined as above, 
Ty is the teacher with whom T) is being compared, S,/S,, 
is the ratio of Sit /8Sx1 , where Sik and Si are defined 


as above, and the plus sign is interpreted to mean that 


Si > Sy , and a minus to indicate a reversal, meaning Si < Si : 


It is significant to note that T) loses twice and ties once 


under such an analysis. 


The importance of the size of N was noted by the 


kk' 
selection committee, and consequently, only reversals that 

occurred with larger values of Nyy1 were considered relevant. 
Table VIII is ranked under each teacher by order of decreasing 


Nuys . - 
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TABLE VI 


N MATRIX 
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20 
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TABLE VII 


S MATRIX 

3 6 
0.0 27.00 
O257.7 0,0 
0755) 2.00 
100 0.0 
0.0 2.00 
0750, 0.0 
O20 0.0 
0.0 0.0 
V200. 0.0 
5.00) 70,0 
0.0 0.0 
150 0529 
297 20,0 
0.0 0.50 
iota O70 
0.0 0.0 
0.0 0.0 
0.40 0.93 
O73) O20 
30) 1.00 
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2.77 
1.14 
O91 
0.83 
O50 
0.0 
0.0 


0.0 


0.0 


0.0 
0.0 

0.13 
20 
0.0 

0.44 
1.00 
1.39 


ORz? 


£550 


0.50 


0.56 





0.50 


TABLE VII (CONT'D) 


S MATRIX 
15 16 
OO ene 500 
O67 Wat 
0.53 0.0 
G70mmm 2.00 
2.03 4.00 
0.0 0.0 
0.33 1.00 
CeGn 020 
0.83 1.00- 
2.00 0.0 
0.0 0.50 
2.30 0.0 
0.88 0.0 
2.00" 80-0 
0.0 0.0 
0.0 0.0 
0.0 0.67 
0.29 0.0 
1-20.) 020 
Gaon  20n0 
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D. SCATTER DIAGRAM ANALYSIS OF oi VS. Ny 


An analysis was conducted on the relationship between 
Si and Ny where Si was the score received by teacher k 
and N, was the voter population familiar with teacher k. 

It would be ridiculous to give the award to the teacher 
who received a perfect score because one person knew him and 
Homiracea him for first place. Thus, in this analysis, it 
was desired to identify a subgroup of high scores that were 
associated with small N, , if any existed; and if so, exclude 


k 
these from competition. Figure 9 is a scatter diagram of 
S. vs. N, . From the eee i, it was concluded that this 
problem did not exist and therefore, a procedure for dissecting 
this space into two half-spaces, one that would be acceptable 
for further analysis and one that would be eliminated, was 
not researched. 

Another purpose of this analysis was to determine if any 
correlation of Sy with Ny could be made, either positively 
or negatively. If it could be concluded that the regression 
coefficient did not equal zero, then it would have been neces- 
Sary to find a different function of the polling data to serve 
as the score, one that was not correlated with Ny : 

Figure 9 again demonstrated that no correlation could be 


made and that the regression coefficient required would be 


zero, thus rendering the preceding analyses valid. 


5S 








k ) 


Ny (# Orava! tots rdentifying J 


- 


FIGURE 9 


vs. N 


Seatter Diagram of Sy) i 
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peo CORE DISTRIBUTION ANALYSIS 

Another special study was concerned with a determination 
of the distribution of the positive scores. With this know- 
ledge, sieetyatetbil ey statements and analyses could be made to 
a@high degree of accuracy. The first step in this direction 
was the construction of a histogram of Si (see Figure 10). 
The histogram showed that the scores have a reverse-J shaped 
tei bution. To estimate the form, the empirical tail- 
distribution was computed. The results are printed in Table 
IX, where 

N is the number of positive scores 


£. is the frequency of the jth scoring-cell, 


TF is the tail frequency, 
and RTF = Ti/N is the relative tail frequency. 


From Table IX, a semi-logarithmic plot of score-cell mid- 
point against RTF was examined. Figure 11 was the resulting 
Ploteana Jt was concluded that a straight line could be mean- 


ingfully fitted to the data. Letting 


y= RTF 
and xX = score-cell midpoint, 
log, g y = - .909x , and converting to the 
natural logarithm, 
-434 ln y = - .909x 
or A aay = -2.09x i. 

and therefore, y = mee. & Consequently, 

_ _-2.09x ; 
P(X > x) =e , and this would yield an estimated 


* 
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FIGURE 10 


Hae tLegram Of Sy 
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302 : FIGURE ll 


seMmi-Logarithmic Plot of Score-Cell Midpoint vs. RIF 
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density function of 5 to be 


k 


£.(s) = pegoe ne) | os > 0 ant 


mhne smooth curve on Figure 10 is a plot of this density 
function. 

It was desired to test the statistical validity of this 
density function as a true representation of the data. A 
pieescuare Goodness-of-Fit Test was chosen. Table X is a 


collection of the data used in the Goodness-of-Fit test for 


-2.09s 


Ho: £,(s) = 2.09e_ ' s > 0 
Hy: Ho false, where 
I,-t,, » Eee li, represent the scoring intervals, 
Pp; = P(S ¢€ I.) under Ho ; Np; is the expected number of 
entries in I, under Hy , and Xs is the number of ob- 
served entries in I. Fi 
ke {xX. = Np.)? 
Define U = )} = , where U is a ran- 
i=1 = NPG 


dom variable that approaches the Chi-Square Distribution func- 


tion with k-2 degrees of freedom as n>~ , Then, Ho 


should be accepted with probability of Type I error equal to 


a , if the observed value of U , 


@ 


2 
u< X,_5(1 - a) . 


Sys) 





6 


14 





TABLE X 


Chi-Square Goodness-of-Fit Test Data 


I, P, = P(S € I,) Np. 
mader i 
0 
Se ee yLes 38.6 
2153 31.4 
.124 25.4 
5 lal 2017 


~] 
e 
N 


ee Se 0} 





op) 
N 


{s,|1.0 < oe 2) 

{S,|1.2 eo et .028 
eos 7) nOcS 

(ie |S, elo oy .029. 5.9 


60 


© 
e 
[oe] 


a) ul 
[= ~J 


42 


34 


Zo 


27 


2 


From the observed data, u= 11.83 , and from the yx 


distribution with twelve degrees of freedom and a= .05 , 


rae (5) ="21.0° 2) Therefore, 


We XS (.95) and Ho is accepted. 


Since the hypothesized density function passed the Chi-Square 
Test, it.was concluded that (15) above was an acceptable des- 


Ccription of the observed scores. 


F. CORRELATION ANALYSIS 

The correlation analyses below were designed to aid future 
committees by providing a better understanding of the voter 
Population. 

1. Coefficient of Concordance Analyses 

Appendix B is a display of data used to estimate the 

effect of age of the voters. It was desired to know if the 
ratings of the teachers were somehow dependent upon the age 
of the individual voter. To accomplish this, Kendall's 
Coefficient of Concordance was applied to the ranking of 
sixty-two teachers by two separate subgroups of the voter 
population. Since military rank is, for the most part, pro- 
portional to age, it was felt that a ranking of the sixty- 
two teachers first by the Ol‘'s , and secondly by the 04's 
would give a wide enough eed in rank to encompass the 
effect of age upon voter nominations. eee Appendix B 
is a 2x62 matrix, where the first row represents the ranking 


of teachers by the 0Ol's , and the second row by the 04's . 


ole 





The choice of sixty-two teachers was made because of 
the following two restrictions. First, it was necessary to 
restrict the population of teachers to those known by both 
observer categories. Secondly, it was felt necessary to put 
a restriction on Ny the number of ballots identifying 
teacher k , in each voter category. Consequently, each of 
the sixty-two teachers eligible for ranking were known by 
Bemmethe 81's and the 04's ; and in addition, at least 
five ballots from the population of 01's and at least five 
from the 04's identified each teacher. 


From Kendall [Ref. 3], 


12s 
7 0 ee 
i Tn) - lam) 7, i 


- 


where W is the Coefficient of Concordance modified to com- 
pensate for the existence of ties within rankings. The ob- 


served data yielded 


S = 69,504 

m = 2 

nan oO 2 

T) = ook 

T. = hee 
and W = .89, 


The statistic W measures the communality of judgment be- 
tween the two rankings. Thus, a W cloSe to one, such as 
the above, indicates a high degree of concordance between 


rankings, and from the above test, it can be concluded that 
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age was not an important factor in how a voter rated the 
teachers, 

At this point, some measure of the SLronmercance Of 
this observed value of W is needed. Such a measure is 
offered by Kendall, utilizing the Chi-Square distribution. 


Define 


7 12s 
ia mn(n + L) 


m(n - 1)W . Then U is approxi- 


mately distributed as Yea ltl = @) with v=n- 1 degrees 
of freedom. From the observed Gata, uz= 108.5 . Since 


v = 61(> 30) degrees of freedom, 


2x? N(11,1) : 


Or v2xX2 eee (0 71) 


Or (V2x7 - ll > z) = .01 , which implies 
VANE, See 2223", 


Thus, ne BoVveomesoecifies the critical region. Therefore, 
the observed value of U _, 


u = 108.5 > Kee 37 eoemand ents concluded 


oe 


- 


that the resulting W above is substantially significant. 
FOr determining the effect of military rank on voter 
choice, a Kendall Coefficient of Concordance was computed for 


rs o- 
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the subpopulation of voters consisting of the 03's , 04's , 
and OS's , a large group that had all ranked a common large 
number of teachers. The test was conducted under the same 
restrictions as above. Appendix C shows the 3x91 matrix of 


rankings. These data yielded 


W= .82 


and u 22208 COnSequencly, 


CS BRATS Kee Sime Ande eheretore. “from 


this analysis, it was concluded that Military Rank did not 
influence the pattern of voter nominations. 

A Coefficient of Concordance was developed for the 
rankings of the Faculty and those of the Students. It was 
desired to know if the Faculty in general, would vote as did 
the Students. Similar restrictions as those above were intro- 
duced to obtain more meaningful results. Appendix D displays 


the 2x193 matrix utilized in the test, with the following re- 


sults: 
W= 273 
and MeoecoO, Consequently, 
nee) 280) > ae = 238 , and W= .73 is 
Oise Significant’ at a= .01. Therefore, it was concluded 


that both Students and Faculty generally agreed on their 


choices. : 


Similarly, it was desired to know how the Alumnus would 


compare to the Faculty in such a test. Appendix E displays the 


- 
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Pelo TMidtrLix Of data. Restrictions such as those above were 


introduced with the following results: 


W= .65 


and 


c 
II 


148 . Conseguently, 


cS 
Il 


14.8 7 ae =——50ewand 1t was concluded 


that W(= .65) was not significant at a= .01. In other 
words, it, could have arisen by chance from a population where 
Faculty and Alumnus were completely unrelated. 

The tests of hypothesis for significance had as the 


null hypothesis and alternative, 


H,: W is not significant 


Hy: W is significant. 


At times, it would be more meaningful to know the value of a 
at which the decision regarding Ho would just be changing 
from accept to reject, given the test statistic. This value 
of a is called the P-value [Ref. 1] and is commonly used 
Semoesulbstitute fOr the critical point. Thus, P =P(W > the 
observed W). The P-value for the above calculations are 
determined as follows: 

Let u* be the observed value of the test statistic. 
Then 

v2u* ayy 
: Se a ae ee 

where H,, and 0, are the mean and standard deviation of 
the Normal distribution approximation of the Chi-Square dis- 


tribution with v > 30 , and 2, _ 5 Teme heommenuO(. — P) 
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Mercentile of this Normal distribution. Now, 


l1-P= N, (2) 7 p) 


and P 


1 - No (2) ) 


7 p) , where N (2) 7 


P 
is the value of the cumulative distribution function of the 
Standard Normal at Z, ~p: 

the results of the Concordance Analyses with their 


respective P-values are summarized in Table XI below. 


TABLE XI 


Coefficient of Concordance Summary 


Observers W P-Value 
Miewand 04". 89 ioe 
03's, 04's and 05's 82 2 10 
Maculty and Students See: < Ly 
Alumnus and Faculty 100 aos 


It was concluded that the Faculty and Students, in 
general, agreed upon their choices and that within the Students, 
agreement was high regardless of age or rank. The lower value 
for W , although not significant at a= .01 , noted in the 
test of Alumnus and Faculty would indicate that graduate views 
differ from current Students and Faculty. 

Be Contingency Table Analyses 

It was desired to know if Academie Rank was associated 
TmetccOle man COmecingency table was developed for Score Cate- 
gory vs. Academic Rank. This test could then conclude whether 


or not scoring was independent of the rank of the teachers 


- 
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concerned; and consequently, whether or not the voter popu- 


lation favored one or more of the teacher categories. 


fore, it was desired to test 


against H 


Score 


Gacegory 
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0 ial ise) 
13 ad # Ba , where 
= i,4)th 
ae P(T, eatie, 3) een) 
meld 
ge P(T, ei score category) 
een 
and 2 = P(T, Ea academic rank) . 


TABLE -XLl 
Contingency Table For 


Score Category vs. Academic Rank 
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Table XII displays the data ina contingency table. 
Each interior cell has two entries. The upper entry repre- 
sents the observed number of teachers of academic rank j 
scoring in score category i . The lower entry of each cell 
is the number of entries that should be in the cell if Ho 


is true. These numbers were found using the maximum likeli- 


hood estimators for w. and 23 [Rek..:4 |: 


n 1 4 
eo eee ee ee — 28 4S 
al 9 tO a 
j=l 
“ 1 2 - 
ences) = —@areen- f= 1,2,3,4 . 
a 


ene is the number of observed entries in each cell. Thus, 


from n sample values , 


DUR 2 = expected number of entries 
in the (i,3)t® cell. 
an AN > 
5 4 (X, - nW,S.) 
imierefore, WS ) ) — 


is approximated by the Chi-Square distribution function with 


twelve degrees of freedom. From the observed data, 


vwe= LOC2 
and Xi, 695) = 21,0. 
Since v< XxX 6°95) 1 Ho is accepted with 
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Puovability of Type I error, a= .05 . It was concluded 

that the scoring distribution was independent of Academic Rank, 
and that the voter population did not prefer any academic rank 
imeparticular. 

A word should be said concerning the score categories 
used above. It was desired to have score categories such that 
each would encompass an equal number of expected entries; and 
in addition, that the expected number be greater than or equal 
to five. To achieve this, the exponential distribution esti- 
mated previously was used, through its inverse function, to 
arrive at five scoring intervals. 

TABLE XIII 


Contingency Table For 


Beeore CatedO@vuva meotudent Curricular’ Area 
Ops Ele Ord 
Ana Eng Eng 

.0001 

22010 


») 
20 
220" 7 
24005) 8.2 
2a OW 9 
4300 }10.7 
10 
0 
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A Similar analysis was made on Score Category vs. 
Peudent Curricular Area. Table XIII shows the resulting 
contingency table. Conclusions as to the independence of 
score category and individual student curricula were of 


miacerest. 


The test statistic now becomes 


Se a oe nW,R.)* 
= 2605 eee ee ee 
Vv » } — J ; 
i=l j=1 nw.R. 
a 


nN 


where Sy is the maximum likelihood estimator of r. 


J) 
probability of falling in the 5th curricular area. Thus 


, the 


V is approximated by the Chi-Square distribution function 


with twenty-four degrees of freedom. From the observed data 


v = 18.6 
2 a 
me aS, 36.4 
Since ve Xe, 6°95) } the null hypothesis of 
independence is accepted with a= .05. 


It was concluded that score category was independent 
of student curricular area, in that the probability of re- 
ceiving a score in one of the categories was not dependent 
upon which student curricula were sampled. 

Due to exceptionally low voter response in three cur- 


ricular areas, only seven curricula were represented in this 


analysis. It is to be noted that the contingency table 
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analyses are specific to the scoring intervals chosen. Time 
constraints precluded deeper analyses of these potential 
associations. 

It was desired to perform a Contingency Table Analysis 
on Score Category vs. Academic Department. Conclusions as to 
whether or not the scoring distribution was independent of 
academic department were of interest. Table XIV is a collec- 
Elon of data for such an analysis. Due to the small expected 


and observed numbers involved, the analysis was not conducted. 
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VI. CONCLUSION 


Members of the Selection Committee made individual eval- 
uation of the special studies presented above in preparation 
for their final choice of an award recipient. Following a 
presentation of the special studies, the committee cast a 
peewee Dallot to choose among the remaining three teachers. 

The meHeS of individual teachers concerned were unknown 
to the Selection Committee throughout the process. At the time 
the above ballot results were revealed, the only name announced 
was that of the winner. His name was. forwarded to the Academic 
Dean and Superintendent, and will be made public at the June 


Graduation Ceremonies. 
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AWARD FOR EXCELLENCE IN TEACHING 


- Background - 


In order to augment the existing incentives for teaching of high quality, the 
Superintendent has established an award, called the Award for Excellence in Teaching. Having 
participated in the educational processes at the Naval Postgraduate School, your opinion is 
of value to the Selection Committee. In order to assess the collective opinion of students, 
faculty, staff, and selected alumni, the committee is conducting this poll. After accumulating 
the voting results the committee will select the Award recipient. 


The committee, mindful of the many measures of teaching excellence, does not wish 
to fix the rationale by which each voter determines his nominations. However, in order to 
assist those voters who desire something more definite as a guide to their thinking, the 
committee offers the following summary of some aspects of teaching excellence worthy of 
consideration: "The phrase, ‘excellence in teaching,' refers to that complex of personal and 
professional qualities and actions on the part of the teacher which (a) make themselves felt 
primarily at the interface of personal contact between student and teacher; (b) help transmute 
the student's encounters with his subject matter into insight, enlightenment and love of 
learning; (c) elicit from the student responses in thought, feeling and action which enhance 
his capacity for self education and (d) manifest themselves in an effective individual style 
which authentically reflects the teacher's own unique personality, experience, character, 
and convictions." 


A meaningful selection of the Award recipient is heavily dependent upon the receipt 
of nominations from a large portion of the eligible "voters." Your response is therefore 
earnestly requested. Please complete the enclosed ballot in accordance with the attached 
instructions. The results of the polling, other than the Award recipient, will be treated 
as privileged information by the committee. 


BALLOTING PROCEDURE: 


Step 0. Complete the information requested at the top of the ballot. These items are for 
purposes of statistical analyses only. 


Step 1. On the list of eligible faculty encircle the number at the left of those with whom 
you are sufficiently acquainted to make a judgment. Use your own guidelines. For 
purposes of establishing a population base, it is important to encircle all with 
whom you are acquainted. 

Step 2. From the subset of faculty you have indicated in Step 1, select from one (1) to 
three (3) nominees. Indicate the order of your preference by placing a number 1, 

2, or 3 opposite and to the left of the appropriate name. Numeral "1" indicates the 
first choice, etc. 


Step 3. You are invited to furnish a short statement in support of your primary nomination. 
Space is provided for this at the and of the ballot. 


Step 4. Return the ballot by April 7. 
Students: Return to your curricular officer. 
Faculty and Staff: Send to Code 55 Bal. 


Alumni: Return via the enclosed return envelope. 
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Part I - 


Statistical (encircle code at left) 


BALLOT 


S$ Student 
F Faculty 
Voter Category A Alumnus 
C Curricular Officer 
Military Civilian 
Branch of Service Curricular Area Rank Oepartment 
N Navy 30 Ops Analysis IR Instructor AE Aeronautics 
M Marine Corps 31 Aero Eng AT Assist Prof AO Aviation Safety 
A Army 32. Elec & Comm Eng AC Assoc Prof MN = =©Bus Ad & Econ 
C Coast Guard 33. Ordnance PR Professor EE Elec Eng 
Lt Air Force 34 Naval Eng GH Govt & Humanities 
F Foreign 35 Env Sci MC fat Se & Chem 
36 Manage & Comptr Sci MA Math 
37) ENngisel ME Mech Eng 
38 Baccalaureate MR Meteorology 
39 Oef Management OC Oceanography 


OA Ops Analysis 
PH = Physics 
NS Navy Manage Sys Center 


Part II - List of Eligible Faculty (all faculty engaged in teaching in the academic year 1969-70 except department 
chairmen and members of the selection committee) 


Aviation Safety Programs 


___ 1014 
__ 1025 
___ 1036 
___ 1047 


Bomberger, R. B. 
Bradbury, C. M. 
Fletcher, J. L. 
Wible, L. C. 


Department of Aeronautics 


___ 1058 
___ 1069 
___ 1070 
___ 1081 
___ 1092 
___ 1108 
__ 1g 
Es 1120 
131 
__ 1142 
___ 1153 
1164 
175 
___ 1186 


Department of Business Administration 


__ 97 
___ 1203 
___ 1214 
___ 1225 
___ 1236 
___ 1247 
___ 1258 
___ 1269 
___ 1270 
___ 1281 
___ 1292 
___ 1308 


Ball, R. E. 
Bennett, J. A. J. 
Biblarz, 0. 
Collins, 0. J. 
Oelph, T. J. 
Haupt, U. 
Kahr, C. H. 
Layton, D. M. 
Lindsey, G. H. 
Miller, J. A. 
Netzer, 0. W. 
Schmidt, L. V. 
Vavra, M. H. 
Zucker, R. 0. 


and Economics 


Carrick, P. M. 
Castro, B. 
Church, W. H. 
Cowie, J. B. 
Oarbyshire, L. 
Eisenhardt, P. 
Elster, R. S. 
Fremgen, J. M. 
Ganz, J. G. 
Githens, W. H. 
Hoverland, H. A. 
Jolly, J. A. 


____ 1319 Lande, R. S. ____ 1658 Parker, S. R. 
____ 1320 Lane, M. L. ___ 1669 Sackman, G. L. 
__‘'1331 Lee, M. ____ 1670 Sheingold, A. 
____ 1342 Musgrave, G. L. __ 1681. Smith, W. C. 
___ 1353 Senger, J. 0. __ 1692 Stentz, 0. A. 
__: 1364 ~Steckler, M. J. ___ 1708 Terman, F. W. 
____ 1375 Wegener, W. H. ___ 1719 Thaler, G. J. 
____ 1386 ~Womer, N. K. ___ 1720 Turner, J. 8., Jr. 
Oepartment of Electrical Engineering See ol Welle A.£. 

____ 1742 Ward, J. R. 
___ 1397 Badger, R. R. 1753 Wilcox, M. L. 
____ 1403 Bauer, W. M. 


1414 
___ 1425 
1436 
1447 
___ 1458 
___ 1469 
__ 1470 
1481 
___ 1492 
___ 1508 
___ 1519 
____ 1520 
__ 1531 
___ 1542 
___ 1553 
___ 1564 
___ 1575 
___ 1586 
___ 1597 
___ 1603 
__ 1614 
___ 1625 
___ 1636 
___ 1647 


Baycura, 0. M. 
Borst, F. W., Jr. 
Bouldry, J. M. 


Oepartment of Government 
and Humanities 


___ 1764 Alexander, W. P., Jr. 


Breida, S. __ 1775 Bjarnason, L. L. 
Campbell, J. 0. ___ 1786 Gabel, B. B. 
Chan, S. G. ___ 1797 Gottschalk, S. 
Chaney, J. G. meeelS0S Hutt, Ba be 
Cooper, P. E. ____ 1814 McAdams, J. M. 
Cotton, M. L. ___ 1825 «- Pearson, L. W. 
Oe Laura, R. 0. ___ 1836 Stolfi, R. H. 
___ 1847 ‘Teti, F. M. 


Oemetry, J. S. 
Ewing, G. 0. 
Gardner, £. M. 


Oepartment of Material Science and 
Chemistry 


Gerba, A., Jr. meeS5seeclarks J. Re 
Hoisington, D. V. __ 1869 Helliwell, R. W. 
Houston, R. K. ____ 1870 Hering, C. A. 
Kirk, 0. E. ____ 1881 Kinney, G. F. 


Klamm, C. F., dr. 
Marmont, G. H. 
Miller, R. L. 


Marshall, G. D. 
McFarlin, G. H. 
Reynolds, M. F. 


___ 1892 
___ 1908 
___ 1919 


Murray, R. P. ____ 1920 Rowell, C. F. 
Myers, G. A. ___ 1931 Schultz, J. W. 
Myers, H. L. ___ 1942 Sinclair, J. E. 
Oler, C. B. ____ 1953 Tolles, W. M. 
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___ 1964 Wilson, J. W. 





Oepartment of Mathematics 
___ 1975 Barksdale, G. L. 
____ 1986 Bender, A. P. 
___ 1997 Bleick, W. E. 
___ 2006 ~Bolles, R. C. 
___ 2017 Brainerd, W. S. 
____ 202B ‘Calabrese, P. G. 
__ 2039 Oavis, 0. L. 
____ 2040 ~Oeaton, L. W. 
___ 2051 -Oixon, O. R. 
___ 2062 _“~Estell, R. J. 
__ 2073 ~Faulkner, F. 0. 
___ 2084 ~Giarratana, J. 
_ 2095 ‘Hunt, R. W. 
____ 2101 Jayachandran, T. 
___ 2112 ~=~Jennings, W. 
—__ 2123 Kildall, G. A. 
___ 2134 Kodres, U. R. 
mee 2 145eeKoliitz 5) Beale. 
__ 2156 ~Little, W. A. 
mee cliGvesitziler.) ben G), 
___ 217B Lucas, K. R. 
___ 2189 ‘Marks, H. B. 
___. aii) GSP Ge Me 
____ 2206 
__ 2217 
___ 2228 
__ 2239 
___ 2240 
__ 2251 
__ 2262 
mee 22/3 
__ 2284 
2295 
__ 2301 
ail 


Oepartment of Mechanical Engineering 
____ 2323'«Brock, J. E. 
____ 2334 Cantin, G. 

__ 2345 «Houlihan, T. T. 
___ 2356 ~=Kelleher, M. O. 
___ eas? (Lane [So Fe 
be 2378) Marto Pde 
___ 2389 Newton, R. E. 
____ 2390 Nguyen, 0. H. 
_ 2406 Prowell, R. W. 
____-2417— «Pucci, P. F. 
__ 242B_ Tyvand, N. P. 
____ 2439 ~Windrey, R. C. 


Oepartment of Meteorology 
___ 2440 Alberty, R. L. 
3476 «=Carrigan, R. C. 
__ 2451“ Outhie, W. D. 
__- 2462 «CE Isberry, R. L. 


Pierce, J. P. 
Preisendorfer, R. W. 
Pulliam, F. M. 
Roberts, A. B. 
Schwarzkopf, A. B. 
Shorb, A. M. 
Singer, E. A. 
Spalding, J. H. 
Stewart, E. J. 
Trahan, D. H. 
Weir, M. D. 

Wilde, C. 0. 


___ 2495 
___ 2501 


___ 2523 


___ 2556 


___ 2884 
___ 2895 


3487 
2473 
2484 
3498 


2512 


2534 
2545 


2567 
2578 


___ 2589 


2590 
2606 


___ 2617 


Hamilton, H. 0. ANE 
MahIman, J. 0. __ 2989 
Martin, F. L. EL 
Oakes, W. ____ 3009 
Renard, R. J. __ 3010 
Taylor, C. L. ___ 3021 


van der Bijl, W. 
Williams, R. T. 


___ 3032 

Oepartment_of Oceanography ___ 3043 
Andrews, R. S. __ 3054 
Boston, N. E. J. ___ 3065 
Crew, H. __ 3076 
Oenner, W. W. ___ 3087 
Geary, J. E. ___ 3098 
Giles, C. F. __ 3104 
Haderlie, E. C. Sule: 
Jung, G. H. ___ 3126 
Smith, R. J. esis? 
Thompson, W. C. _ 3148 


___ 2628 


2712 
2723 
2734 
2745 
2756 
2767 
2778 
2789 
2730 
2806 
2817 
2828 
2B39 
2840 


__ 2851 


2862 
2873 


2901 
2912 
2923 
2934 
2945 
2956 
2967 


____ 2639: «~‘Thornton, E. B. __ 3159 
___ 2640 Tucker, S. P. ___ 3160 
___ 2651 van Schwind, J. J. Sei 
___ 2662 Wickham, J. B. ___ 3182 
Oepartment of Operations Analysis — Ns 
___ 3209 

2673 Andrus, A. F. __ 3210 
2684 Arima, J. 3221 
___-2695 «Barr, O. R. ___ 3232 
___ 2701 ‘Barrett, E. B. 3243 


Burnett, T. 0. 


__ 3254 
Burton, R. M. 3265 
Butterworth, R. WwW. ___ 3276 


Connolly, J. P. 


___ 3287 
Cunningham, W. P. 


____ 3298 
Ferguson, R. L. 3304 
Floyd, J. 3315 


Forrest, R. N. 
Gieseke, W. J. 


Greenberg, H. _- 3326 
Heidorn, G. E. — shstely/ 
Higgins, J. E. __ 3348 
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